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ABSTRACT 

the introductory Computer Science course has changed significantly. No longer 
is it a simple introduction to programming or a tutorial on computer concepts 
and applications. Rather, it has become a survey of the field of Computer 
Science, touching on a wide variety of topics from digital circuits to human- 
computer interaction. Without sufficient resources, students can be 
overwhelmed by this broad range of topics, with sufficient resources and an 
interface to tame the potential flood of resources, they can better 
comprehend the class topics . Resources that benefit students include : the 
course guide; an extensive, well- linked, syllabus; blackboards, 
transcriptions, and instructor's notes from each class; more in-depth notes 
on topics prepared by students; and questions and tips from other students 
(with answers and further comments from the instructor) . This paper describes 
the design and creation of such a web of resources "on the fly, " while the 
course is being taught. The design and creation of this web touches on many 
issues, including mechanisms for convincing students to use the web; the 
balance between online hypertext and printed documents; problems and benefits 
of live update (the collection of resources changes frequently, as each class 
period generates new resources) ; the roles of audio and video; and, most 
importantly, student reactions. (Author) 
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Abstract 

As the field of Computer Science has grown, the syllabus of the introductory Computer Science course has changed 
significantly. No longer is it a simple introduction to programming or a tutorial on computer concepts and 
applications. Rather, it has become a survey of the field of Computer Science, touching on a wide variety of topics 
from digital circuits to human- computer interaction. 

Without sufficient resources, students can be overwhelmed by this broad range of topics. With sufficient resources 
and an interface to tame the potential flood of resources, they can better comprehend the class topics. Resources that 
benefit students include 

• the course guide : 

• an extensive, well-linked, syllabus : 

• blackboards , transcriptions , and instructor’s notes from each class; 

• more in-depth notes on topics prepared by students : and 

• questions and tips from other students (with answers and further comments from the instructor). 

This paper describes the design and creation of such a web of resources "on the fly," while the course is being 
taught. The design and creation of this web touches on many issues, including mechanisms for convincing students 
to use the web; the balance between online hypertext and printed documents; problems and benefits of live update 
(the collection of resources changes frequently, as each class period generates new resources); the roles of audio and 
video; and, most importantly, student reactions . 



Contents 



Abstract 



Introduction 

Methods 

o Subjects and Setting 
Platfomis and Software 



PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL HAS 
BEEN GRANTED BY 



o 

o 

o 

o 

o 



cO : 

,V ^ 

^ERIC 



Resources 

Design of HTML Documents 
Procedures for Distributing Resources ‘ 
Evaluation Criteria 
Results and Discussion 
o Class Outlines 
o Electronic Blackboards 
o Student-Authored Notes 
o Class Transcriptions 
o Interactive Examples and Experiments 
o Questions and Answers 
Conclusions. Recommendations, and Future Work 
Acknowledgements 
References 
Biography 




TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 



U.S. DEPARTMENT OF EDUCATION 
Office of Educational Research and Improvement 
EDUCATIONAL RESOURCES INFORMATION 
I CENTER (ERIC) 

IH This document has been reproduced as 
/\received from the person or organization 
oTtginating it. 

□ Minor changes have been made to 
improve reproduction quality. 



Points of view or opinions stated in this 
document do not necessarily represent 
official OERt position or policy. 



BEST COPY AVAILABLE 



hltp://www.ncsa. uiuc.edu/SOG/IT94/Proceedings/Educ/rebolsky/rebelsky.html 



Tuesday, May 2, 2000 



Page; 2 



1. Introduction 

Hypermedia rBush451 and multimedia lBuf941 have begun to change the way teachers teach and students learn 
(e.g., [OT94]). Although these technologies have not yet reached the stage in which they can be used to teach any 
topic to any student, interactive multimedia can provide additional support and resources for students and teachers in 
traditional classes. 

During the summer of 1994, I used Mosaic and the World-Wide-Web to provide a variety of resources for an 
introductory survey course in Computer Science. Because of time restrictions, much of the development, design, 
and creation of these resources had to be done "on the fly," as the course was being taught. This paper presents my 
experiences in the design and implementation of an interactive networked support system for that class and touches 
on the things I learned by preparing the system, what students thought about electronic resources, and what I will 
change in the future. Although this paper highlights experiences with a particular class, it is likely that the 
methodology and system used in this class can apply to a variety of classes and educational situations. 

As computers continue to play an increasing role in academia, business, and everyday life, more and more students 
are choosing to take an introductory course in Computer Science. Students are attracted to the course because they 
believe it is useful, interesting, or necessary to know more about computing. These students come from a variety of 
backgrounds ranging from art history and humanities to physical sciences and engineering. Therefore, they bring a 
wide range of experiences, needs, expectations, and learning styles to the class. Both the variety of students and 
advances in the field of Computer Science suggest a new type of introductory course which surveys the field of 
computer science (e.g., rBie90.Bro94 . DH94.SG94B rather than teaching only programming or computer 
applications. This new introduction may cover algorithm design, analysis, and implementation; programming; 
human-computer interaction; digital-circuit design and computer architecture; artificial intelligence; networking 
design, protocols and applications; history and social issues; and a wide variety of other topics. This new course 
better serves the needs of a broader variety of students (particularly nonscientists, who should learn about computing 
but need not learn a significant amount of programming). Such a course has a real place in a liberal arts education as 
it teaches a new (and, to many of these students, very different) way of thinking, rather than teaching technical 
skills. 

Because the course presents a broad variety of topics to many different types of learners, it must accommodate the 
different learning styles that both the topics and students require. Personal experience shows that some students 
learn best from reading the book, some from class lectures, some from experimenting using to a fixed 
experimentation plan, some from experimenting freely, some from talking to other students in the class, some from 
teaching topics to other students in the class, and some from still other methods. And learning varies from topic to 
topic. For example, McKeachie lMcK861 suggests over twenty different teaching mechanisms and corresponding 
benefits, situations, and learning styles. 

To accommodate these needs, the designer (instructor) of a course should attempt to provide a variety of learning 
resources. However, care must be taken to emphasize and rank resources so that students are not overwhelmed by 
too many resources. The World-Wide-Web (WWW) provides an excellent platform for developing, organizing, and 
disseminating a wide variety of resources, including class notes and outlines, longer textual resources that resemble 
traditional textbooks, interactive nonlinear tutorials, student questions and comments, and even simulations of 
individual class sessions. The WWW also allows instructors to prioritize resources and students to reorganize the 
resources in the way that fits them best. 

This is not to say that a WWW-based web of resources should be used instead of lecture, discussion, laboratory, and 
homework; the web-based resources are intended to supplement and not replace traditional learning methods. Nor 
is it to say that students should be presented with an unorganized web; as fLR911 suggests, while hypertext benefits 
some students, other students learn best according to fixed, linear, lesson plans. 

In addition to their role in providing resources for the class. Mosaic, the WWW, and HTML (the markup language 
used for creating WWW documents) provide valuable topics for discussion in an introductory Computer Science 
class. For example: students can study hypertext by writing documents in HTML; think about user interfaces while 
evaluating the interface to Mosaic; comment on, evaluate, and discuss networked hypertext documents (e.g., the 
electronic version of Bruce Sterling's The Hacker Crackdown fSte921 ); and discuss the implications of the 
networked resources available through the WWW. HTML can also serve as the basis for discussion of logical 
formatting, of the need to make documents both human- and computer-readable, and of computer-based translation 
and compilation. 

^ hllp://www. ncsa.uiuc.edu/SDG/IT94/Proceedinga/Educ/rebolsky/rsbel5ky.html 
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I am not alone in attempting to make class resources available through the WWW. The University of Texas at 
‘Austin maintains an extensive guide to a variety of web-based class resources 1 UTA94 1. This collection shows that 
classes and instructors use the web in many different ways. Some classes provide just a few notes or an introductory 
syllabus. Some use the web as a dissemination mechanism for student essays. Some use the web to personalize the 
class, providing student pictures and home pages as part of the web of resources. 

I am also not alone in incorporating HTML authoring into the course syllabus. Many of the courses that provide 
web-based resources also require students to author a home page or to use the web to search for other resources. 
r Weg941 details an introductory course that incorporated HTML and Mosaic and allowed students to create 
HTML-based final projects. 

2. Methods and Background 

2.1. Subjects and Setting 

Twenty-five students and four auditors participated in the course. The students came from a variety of backgrounds 
and fields and included English majors, Economics majors, a Theater major, and a graduate student in Earth 
Sciences. Auditors included two high-school students and one new faculty member. Some students had programmed 
before, although many had only used their computers for word processing and electronic mail. 

The course met three times weekly for a 65 minute session which consisted of both lecture and discussion. Students 
also attended a weekly one-hour lab. Students were evaluated according to their work on two open-book exams, a 
variety of long (8-15 hour) and short (10 minute-1 hour) homework assignments, a final project, a set of notes on a 
topic chosen by the student, and class participation. The class included an optional weekly question-and-answer 
session conducted by the instructor and 9-12 hours of informal tutorials with undergraduate tutors. Students were 
encouraged to ask questions of the instructor and tutors via electronic mail and in person. 

2.2. Platforms and Software 

Electronic course work was done on Macintosh computers, using HyperCard version 2.1 [ Cla90 ] and Version 1.0.3 
of NCSA Mosaic for the Macintosh 1NCSA931 as the primary software platforms. HyperCard was used as a medium 
for students to develop and explore hypermedia documents and to write simple programs. It was also used as the 
implementation platform of many other components of the course (e.g., animated searching and sorting algorithms, 
an assembly code "interpreter," and a simple computer simulator). Mosaic served as a dissemination mechanism for 
class resources and as a motivating example for the topics suggested previously. 

2.3. Resources 

Because a primary goal of this experiment was to accommodate a wide variety of learning styles, we attempted to 
provide as many resources as possible, and to provide these resources in multiple forms (e.g., printed, HTML, and 
HyperCard). The WWW-based resources for this class included; the course guide (describing the goals and policies 
of the course and providing some background information), a syllabus with links to appropriate documents, a 2-5 
page outline of each class's topics, homework and laboratory assignments, interactive tutorials and experiments, the 
text and graphics from blackboards, student-authored notes on individual topics, transcriptions of each class session, 
and questions and answers (compiled from class, electronic mail, and personal meetings). Although some of the 
resources (e.g., the course guide and first homework assignment) were created before the term began, most were 
created as the course progressed. All electronic documents were created directly in HTML rather than converted 
from another format. Most documents included significant number of links, both internal and external. 

Although all sessions of the class were audiotaped and videotaped, I decided not to make the video and audio 
available, either on tape or in digital format. In part, this decision was motivated by my belief that students should 
attend class because they benefit from interaction in class. In part, this was because the resources were not available 
to distribute the audio and video electronically. In part, this was because educational research suggests that plain 
video does not provide significant learning benefits f Lev9 1 . MSM92 1 and there was not time to put these resources 
into a comprehensive interface, such as the proceedings interface described in [Reb+95]. 

Other resources provided for the students included a textbook 1 SG941 . sample programs and homework solutions 
from past classes (created by both students and instructors) that students could use in developing solutions to related 
homeworks, a collection of animated sorting and searching algorithms, appropriate photocopies of key articles, and 
'■A^^ware related to the course (e.g., Microsoft Excel and a circuit design program). 

^ h»p;//www.ncM.uiuc.oduySOG/IT94/Proce©dings/Educ/rabol*ky/rebel8ky.html 
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2.4. Design of HTML Documents 

Because students would be using and accessing a broad variety of class documents on the web and because they 
would also be using the documents as an example of how to design hypertext documents, it was important to 
develop a coherent and consistent document format. While rCoh941 and rB-L941 provide some general 
recommendations on the design of HTML documents, not all of their suggestions are pertinent or even appropriate; 
the creation and collection of documents for a class suggested other design features. As with the construction of the 
documents, many of these design decisions were made as the class progressed and were motivated by particular 
needs or realizations. 

Experience shows that students print many of the text-based resources they use rMook94 . Win94] . Hence documents 
should be designed for printing and reading on paper as well as for onscreen viewing. For this course, I tended to err 
towards designing documents for paper viewing. However, some principles of design that apply to electronic 
documents also improve the readability of printed copies. For example, I tried to preface every document with a 
simple table of contents that contained links to the individual sections (and, similarly, a "return to table of contents" 
at the end of each section). While the electronic purpose of such a table of contents is navigational, research shows 
that such preliminary information improves students' comprehension of textual materials r Kru-n891 . In addition, 
onscreen marks, such as horizontal rules, also help with reading printed versions of the text and provided visual cues 
for major breaks in handouts (e.g., the switch to a new topic in a class outline). 

Because it was important for students to know when documents changed, I included the change date at the top of 
each document (after the title). This allows students to immediately determine whether a document has changed. 
Finally, because students were reading some documents on paper and some onscreen, the links to external 
documents were also described explicitly (as in the list of references for this paper). 

2.5. Procedures for Distributing Resources 

In addition to being available through the web, many course resources were provided in other forms to help the 
students prioritize the resources. 

• The most important resources were printed and handed out at the beginning of each class. Such resources 
included the course guide and syllabus, assignments, and the outlines of individual classes. 

• Somewhat less-important resources were sent through electronic mail. These included comments on 
assignments and answers to select questions. 

• Other resources that might only be appropriate for certain types of learners were put on the network and the 
students were informed of their existence via electronic mail, a mention during the class session, or a pointer 
in the class notes. These resources included the transcriptions, student notes on topics, and broader collections 
of questions and answers. 

• Some regularly created resources, such as the electronic blackboards, were mentioned only at the start of the 
term. 

So that students could access and find documents in the way that best suited each individual, every document could 
be reached through a variety of paths. 

• The primary documents (class outlines, assignments, handouts) were available through the course syllabus 
according to the date of the class or assignment. 

• Each day's class outline included links to all the documents handed out that day (at the top of the document) 
and to related documents, such as the blackboards or transcription for the class (at the end of the outline). 

• Each category of document (class outlines, class notes, homework assignments, blackboards, shorter tasks, ) 
had its own index accessible directly from the course home page. These indices also served to show how much 
of any resource was presently available (e.g., by opening the index of transcriptions, a student could see how 
many classes had been transcribed). 

• Document names and locations were chosen with consistency in mind so that students could guess URL's (the 
"universal resource locators" for documents in the WWW) if necessary (although it appears that no students 
attempted to do so). For example, the transcription for July 5 can be found under the name 
"transcription.94.07.05.html" in the directory "Transcriptions" and the blackboards for July 6 can be found 
under the name "blackboards.94.07.06.html" in the directory "Blackboards." 

• Finally, all the documents were originally put in a WAIS database so that students could search through them 
by keyword. Because students expressed little, if any, interest in using such a feature, creation of the WAIS 
index was discontinued. 
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2.6. Evaluation Criteria 

It is, of course, difficult to evaluate the success of a teaching method (e.g., lMcK86 . pp. 260-265]). Hence, student 
reactions and effects on the course instructor were used as the primary evaluation criteria. 

At the end of the term, students were given a survey to determine their reactions to both the electronic resources for 
the course and to the various course topics [Reb93b]. This survey included much more specific questions than 
traditional course evaluation forms and asked the students to comment on many of the components of the web and 
segments of the course. Although it would have been preferable to conduct this survey using the Mosaic /ormj 
feature, most students were still using NCSA Mosaic for the Mac version 1.0.3 [NCSA93], which does not include 
this feature. In addition, many students prefer to write, rather than type, answers to questions. Hence, while the 
survey was prepared as an HTML document, it was presented to the students on paper, and most of the students 
returned it using paper (one student used an electronic version that he modified by hand). The response rate for this 
survey was high; over 90% (23 of 25) of the students in the class filled out survey forms. 

3. Results and Discussion 

Students generally appeared satisfied with (or even enthusiastic about) the resources provided on the web. From 
reactions to the survey, it was clear that different students used different resources. The most commonly used 
resources were the class outlines, frequent questions and answers, and blackboards (however, the traditional course 
guide, syllabus, and assignments were not mentioned in the evaluation form). 

As expected, students said they were not able to use all the resources or features provided for them. Although a goal 
of the design of the web was to provide documents that students could search and use "on demand,” most students 
worked in more of a "print and read" mode. Many students indicated that they would prefer to have the resources 
chosen for them. 

With so much time available, it is essential to limit the resources we will use or we will never finish any 
assignment. At times, I felt guilty for not conscientiously printing out transcripts, blackboards, etc., etc. 
However, to use all the resources would lead to being at your computer 24 hours a day. 

Others have also found that students prefer to print documents rMook94 . Win941 and, given this predilection, it 
seems best to provide more important documents to students in printed form as this helps the students prioritize class 
resources. 

Although I had some concern that students would use the online resources as an excuse to miss class, only two 
students made a regular habit of missing class. Other students also missed the occasional class. However, the 
number of attendees was not out of keeping with normal attendance patterns. For those who missed the occasional 
class, the online resources provided a backup. While most students used only outlines for review of missed classes, 
at least one student (other than the two who regularly missed class) used class transcriptions for reviewing the 
occasional missed class. 

In spite of the problems mentioned above, it was useful to provide this web of resources. Different students did, in 
fact, find different resources useful and the students who took the time to use the resources electronically 
commented that electronic access was particularly helpful. I also found the creation of the web stimulated my 
thinking and forced me to reevaluate many components of the course. 

The following sections present extended discussion of the motivation for, design of, reactions to, and 
recommendations for future use of individual class components. 

3.1. Class Outlines 

Prior to each class, I prepared a 2-5 page outline of the topics and issues to be covered during the class session. This 
outline was not intended to be a comprehensive guide to the topics, although it was also more than a simple outline 
and often included long passages on individual topics. In addition to making these outlines available electronically, I 
handed them out at the start of each class so that students could use them as the basis for their own note taking and 
to give students a better sense of the topics that would be covered in that class. Because certain classes need to 
develop in different directions or provide new ideas, I used the outline as a basis for the class, but did not slavishly 
adhere to the structure or content of the outline. 

http://www.nc8a.uiuc.aju/SDG/IT94/Proc6Wjing8/Educ/rebel8ky/robalsky.html 
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I also used the outlines to present administrative information (upcoming homework due dates, lab sessions, revisions 
^to homework assignments). These pieces of "administrivia" were included in the outlines so that students could 
'quickly determine changes to the schedule and remind themselves of deadlines. These outlines were an extremely 
successful component of the class web. According to the survey, all the students used the outlines in at least one of 
the two forms (printed or HTML). Students did not object to the lack of adherence to class outlines (although three 
did comment that it was an occasional problem). 

[The outlines were] good for looking through later and getting the basic points and as a reference during 
class. Were also very accurate— if had been more they would have been forced. The professor allowed 
class to move naturally in digressing, but still stuck to basic points. 

Although the outlines were useful for both students and instructors, they were among the most time-consuming 
resources to prepare. Some of this problem may be alleviated when they are reused in future classes, although 
reusing outlines eliminates their benefit of forcing the professor to rethink the organization, content, and 
presentation of topics. Another problem with the outlines was that they discouraged students from using the book, 
and gave the students a somewhat less positive view of the book. 

3.2. Electronic Blackboards 

During each class period, I used an electronic blackboard (a pair of HyperCard stacks developed specifically for this 
class that presented four "board spaces": two lower boards for newer information and two upper boards for older 
information) in place of a traditional blackboard or slides. While it would be possible to prepare a set of 
slides/transparencies in advance, or to use the class outline as the blackboard, I thought it best to make the electronic 
blackboard as close as possible to a traditional blackboard; with the content of the blackboard guided not only by the 
lesson plan but also by student comments and reactions. For example, the blackboard would also be used to present 
and analyze a student's in-class solution to a problem or to present the answers to questions asked in class. 

These electronic blackboards provided somewhat less writing space than a traditional blackboard and were harder to 
draw on than a traditional blackboard (at least for this instructor). However, I find it much faster to type than it is to 
write, and my typing is generally much more readable than my reading. Additionally, the electronic blackboard 
provides a better history of the class which could be used both during class (e.g., "as we saw twenty minutes ago 
E") and as a review after class. The use of blackboards for history and review were the primary motivations for 
using electronic blackboards. The availability of the electronic blackboards also allowed students to pay closer 
attention to class and less time scribbling down notes. 

[I]t was nice to know that we didn't have to spend the lecture hour frantically writing notes, since it's all 
[available online.] 

In addition to providing the original HyperCard-based blackboards, I also provided the content of the blackboards in 
HTML format. In designing the HTML version of the blackboards, I attempted to strike a balance between 
mimicking the original format and accommodating the uses and limitations of HTML. Each pair of blackboards was 
treated as one "page" (separated from other pages by a horizontal rule) and annotated with the times I started writing 
on the blackboard and stopped writing the blackboard. The blackboards had no table of contents, although they did 
include links to related documents (in particular, the class outline and transcription). In general, I found the HTML 
versions of the blackboards easier to read, print, and understand. 

Students were generally satisfied with the electronic blackboards, and all said they used the electronic blackboards 
(even though I did not mention their availability after the first week of class). Although the HTML format appeared 
to provide better printouts and was often better edited than the HyperCard version, the majority of students used 
only the HyperCard stacks. I would assume that they did not use the HTML versions of the blackboards because 
they did not know they existed or because they wanted to see the blackboards in the same form that they saw them 
onscreen. 

Because of the limitations of the computer screen, and my decision to make four blackboards visible at any one 
time, I could only fit a limited amount of text on one blackboard. Many students criticized the design of the stacks, 
in part because of the limited text that would fit on screen, in part because the blackboard stacks did not fit on the 
smaller student monitors. It may be that a less sophisticated interface (e.g., using a word-processor for the 
blackboard) would suffice. 

Student comments suggested that the electronic blackboards were only useful as references for those who had 
attended class. 

^ , hup;// www.ncM.uiuc.odu/SOG/iT94/Proceodings/Educ/robotsky/reb el8ky.htm I 
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The blackboards were good review for a class that I had been to, but not one that I'd missed— I don't think 
I would change that. 

Students also used the electronic blackboards as references when studying for exams (and during the open-book 
exams). I observed many students with stacks of paper containing the text of the blackboards. 

There were further drawbacks to the blackboards. Because I was typing, rather than writing, I tended to write more 
than I would have otherwise. Students noticed this and suggested that I might edit them after class and add a table of 
contents or links within the blackboards. 

The blackboards generally served the purpose of traditional blackboards - providing students with something to 
refer to during class that gave a close history of the class. One student observed that the electronic blackboards 
included what they felt was extraneous information but acknowledge that such information also appears frequently 
on traditional blackboards, 

A little less of the class comments etc. that were not useful. [...] Then again, if you use like a regular 
blackboard and still take notes, they are helpful. 

Many students felt that the outlines and blackboards worked well together and obviated the need for other resources. 

I didn't use the transcriptions because most of the information was already in the class outlines and the 
blackboards. 

3.3. Student-Authored Notes 

It has been suggested that students are often better at explaining topics to each other than we are at explaining the 
topics to them IMaz931 and that students learn topics better when they try to explain them (AnnSSI . To incorporate 
these ideas in the preparation of resources for the class, I asked the students to write short (1-3 page) summaries of a 
topic of their choice [Reb94c]. These summaries gave students the opportunity to learn more about topics that 
interested them and to focus their thoughts on a topic. Students were allowed to pick their own topics and were 
given until the end of the term to prepare their notes. 

In general, students prepared useful and interesting summaries, although the occasional summary was wildly 
inaccurate and required significant revision. Because I had not provided an HTML standard for them to use, their 
documents had inconsistent formats and required some time to put into a reasonably consistent form. However, most 
attempted to mimic the form I used for most class documents, with a table of contents at the beginning and a link to 
the course home page at the end. 

Although students were told about this assignment on the first day of class, almost all the students waited until the 
last day of class to turn in their notes (and some asked for extensions beyond that date). Hence, the resources were 
not used for this session of the course, but will be used in the next session. 

3.4. Class Transcriptions 

Although I chose not to make the audio and video of classes available, I did want to make some record of the class 
available because I thought the students would be interested in using the records of individual classes for review, as 
a replacement for the occasional missed class, and as the basis of electronic searching. I assigned one tutor to 
transcribe each class and I attempted to edit and annotate the transcriptions. This part of the experiment was 
somewhat less successful. It took an enormous amount of tutor effort to transcribe the classes, and a reasonable 
amount of my time to update and annotate the transcriptions. Very few students used the transcriptions. Those that 
did either used them when reviewing for exams or as a substitute for missed classes (as mentioned above, two 
students apparently used them as an excuse to miss the majority of classes). 

However, the transcriptions did provide a separate benefit: they gave me the opportunity to think about how I 
presented various topics and how to incorporate descriptions of actions into textual commentary. While I don't plan 
to use transcriptions again, I do plan to experiment with these transcriptions to see whether they can be put to other 
uses (e.g., generating better class notes for the next class session). 

3.5. Interactive Examples and Experiments 

_ http://www,ncsa.uiuc-«Ju/SDO/IT9i/Proc88ding&/Educ/rebelsky/r9b8l«ky.html 
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Although most of the interactive experiments I created for the class were in HyperCard format, I tried to create a 
few using HTML. In general, these HTML- based examples were structured introductions to a topic or idea. That is 
*they ask a series of questions that build up to a final idea. 

For example, in an experiment to construct a circuit for a four-bit adder, the document describes what a four-bit 
adder does and reviews binary notation and then asks the student 

1 . to describe the algorithm one would use to add two four-bit numbers (which suggests to the student that the 
circuit will need to incorporate a carry bit), 

2. to build the truth table for a one-bit half adder, 

3 . to use that table to build a one-bit half adder, 

4. to describe the process of adding three one-bit numbers, 

5 . to use that algorithm to build a one-bit full adder, 

6. to implement the four-bit addition algorithm using these half adders and full adders, and 

7. to test the adder. 

I used one of these structured experiments in class, with students discussing each step with each other, assigned one 
as a take-home exercise, asked the students to write their own exercise, and left some as optional exercises that 
students could follow if they felt they needed more information or experience on a particular topic. Students 
generally found the experiences useful. 

[B]y using the examples of comparators and MUX's I was able to develop a good knowledge of 
[circuitry]. 

These interactive examples could be improved with links to answers to the individual steps of the example, but time 
limitations prevented such comprehensive answers (in part because many of them required graphics). In future 
sessions of the course, I expect to incorporate more of these interactive experiments. 

3.6. Questions and Answers 

No matter how hard we try to predict the needs of students, there will always be problems and questions that 
assignments and lessons fail to address. Traditionally, classes include some way for students to ask questions and 
have those questions answered (e.g., in a question-and-answer session, during tutorials, during office hours, or via 
electronic mail). These questions and their answers can serve as a resource not only for the students who ask the 
questions, but also for other students in the class. Students who are unwilling or afraid to ask questions can often 
find their questions and corresponding answers in this repository. Students who are afraid to ask questions or 
because the fear that questions will show that they lack knowledge may be more willing to admit confusion when 
they see that other students have similar questions. Students may also find questions that they hadn't thought to ask 
and another's student's questions might reveal other aspects of a topic or assignment that the student had not been 
aware of. Collections of questions and answers can also benefit the instructor as they reduce (but do not eliminate) 
repeated questions and provide a resource for answering further questions. 

Because the class was relatively small, I was able to act as the primary resource for answering many questions. The 
tutors for the class occasionally sent me collections of questions that they had been asked (most often the questions 
that they were unable to answer). I had also hoped to use the class transcriptions to provide additional questions and 
answers (particularly from special tutorial question and answer sessions held every week), but was unable to present 
these questions and answers in a timely fashion. However, the electronic blackboards from those sessions did 
provide a form of question and answer repository which was most useful for students who attended the question and 
answer sessions. 

After collecting questions on a topic or assignment, I regularly summarized questions and answers and provided 
them to students in three ways: 

• In the web, with a table of contents listing all the questions categorized by subject. This mechanism allowed 
students to quickly see what questions had been asked and to select only the questions that interested them. 

• Using a WAIS-based search engine. This mechanism allowed students to look up the questions that mentioned 
a particular topic. Although one of the initial assignments was to search for questions and answers using this 
mechanism, most students reported that they did not use this feature because they didn't think about it or didn't 
remember about it. 

• Via electronic mail. Because I suspected that students were not always using the online repository, I thought it 
appropriate to send some of the more pertinent questions and answers to the class as a whole. 
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Providing a collection of questions and answers proved quite successful. However, it is not clear that providing 
them through the web was necessary. Only five students reported that they used the listing of questions, and only 
three reported that they used the search feature (one who used it suggested that he could usually tell which 
documents were of interest, so it was unnecessary). Nonetheless, all students reported that they appreciated 
receiving a regular collection of questions and answers. Two comments summarize the general reactions and suggest 
that expectations for questions and answers were largely met. 

The "recent questions and their answers" from other students really helped. Often you have a similar 
question, but don't feel like asking 10,000 questions. 

I liked them; sometimes I found the answers to questions in the [mail messages] which saved me from 
having to ask them. 

I plan to continue this policy of recording and distributing questions and answers (which I have also used in the past, 
although somewhat less formally). I expect to maintain all three distribution mechanisms, as I expect that some 
students can be better served by indices and WAIS. For others considering this idea, I would suggest appointing a 
tutor to record in-class questions and answers and to put them in HTML format immediately after each class. 

4. Conclusions, Recommendations, and Future Work 

Experience with this class shows that students benefit (or feel that they benefit) from added resources, although they 
are likely to become overwhelmed if the resources are not organized and prioritized. There is a possibility that the 
benefit may not be tied directly to the resources or to their availability on the web; it may also be that student 
reactions (both in terms of the topics they learned and their feelings about the class) are more closely tied to the 
effort these topics required. It would seem that the more time and effort spent on a class, the more successful the 
class would be and the more the students would appreciate it. 

It is likely that the majority of students would have been just as well served by only printed documents with the 
occasional e-mailed list of questions and answers. However, there were a few students in the class who made ample 
use of the web of class resources and clearly benefited from hypertext access to these resources. Such students 
suggest that although a web of resources may not benefit the typical student, they are valuable in supporting a wide 
variety of learners. Additionally, the electronic blackboards seemed to provide some use to many students, although 
I would guess that students used them in quite different ways. 

Of course, there are other reasons for creating a web of resources for a course. As suggested earlier, creating the 
documents and the links between the documents forces one to rethink topics and their relationships. This 
reevaluation can be quite useful. In addition, by creating such a web of resources, an instructor can provide 
information and ideas for others teaching the class (either locally or at another institution) and provide self-study 
resources for students interested in learning topics outside of class. 

For those interested in pursuing a similar developing a similar system, I would recommend restricting the electronic 
documents to traditional, class outlines, and questions and answers. If resources are available for using and showing 
electronic blackboards (whether special software or word-processors), they provide a useful resource that students 
appreciate and that helps both students who like to take notes and students who do not like to take notes. However, I 
would recommend evaluating the blackboards after each class to correct errors and to evaluate whether too much or 
too little is being written on the boards. 

Now that these resources have been collected, there are many possibilities for reusing and modifying them. One 
future direction is the use of these materials in a coherent class simulation that includes class outline, transcriptions, 
blackboards, audio, video, and even interactive experiments. Such an interface might be an extension of an 
interactive talk from an electronic conference proceedings (e.g., 1GMM93 . Reb+95]) or might take a separate 
direction. It is also likely that these resources can provide additional help for select students in another instructor's 
version of the course. Both will be investigated in the coming months. 
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